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4. m w it £ m v * x At 



^yiJtoSIC »i&&K (coarse-grained) *> £ ifffl&g 
(fine-grained) *t?*i#«-rS. Mttt'C? 

a©*t#tW£fc-*7*^~f ^. ^-y^ftil 
T^5. -J, ^#WX-/s«^* (VLIW: 
Very Long Instruction Word t>tttf) RISC /n 

H^^nS. #f£T{i^^7°nHr-,^fatf&?lJ 
Q -fe -y -^^rffl^fc^J^tC «fc otl 

FORTRAN © «k r> IC J§*0 V 7 h 7 a TgS* 

£ f^&K: ttft^T" a ^ 7 a £ g gft&yiHff -5 => 
7 fc«ktf&>aKb#m£2:$-rs fxf A*i 

C C Sfe^O^JfiiS f ^ x A ©S& Ir] IC «fc 5 i , 

-5. 4#,cg2, £&©;istt1i6 Riser a 

v * * 7 x * <ffc b f^m 4r - 7 t' 'J r -r <fc 3 
X h/*-7 * > t>&.3£%#>'C^ 



t P.ralleliation A»i« System by Sumio KIKUCHI (Ctnlril 
RtKirch Uborttoty. Hiuchi, Ltd.). 



?'Ji3xEiRi^(t«©ste'fb^^«fe> * u ^yiJieJE 

tblti^bT HPF (High Performance Fortran) 

*||-CW, ^7*n^7A0ftW&S<rMidtlt 
> * 'J ffi&?Utt*«|qJ#afe7!Mb£«. 36^7* a 

^&©ll@K:o^T«?ii£-<r3. 

2. &9Hb£8->X?A©&£tt<fcg#£tfr 
2.1 & K 14 

r 7*7g&©W3&*Jffl£eit). JtV33— 
?lHbftl&©&fl£&;*Je&1~ Kt#i8BTt 
<e©jti6K:|ift3fe©@fi!>-<? r;Hb&tfSf^ 

3fe?IJ&aJC^^Tt>il!l^HbWS?rftrfit? 

^o^tt«*«f§6ntt^. ^bTM^bbx 

t> 1 i$(Dt££lOm<tiZC£t>&t. COCt 
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it, »ono©ci«-Sc»-r5. 

t&m±, xmttnmttts. 

h kw- tit £it*tii)i^ tz&mtzfj ?ct ifi&m 

£lC«?tff-f £ £ i ttftHSttK £ 4D«>TBJi^>>- - 
Z. iztz.\i, tiMfa^c DO * -7 ®UU%.Wi 

e^l-oKtt^* £ nr *$ «3 c ©s£&*i7° n 7 ^ 
<y 7«c©^9/<r^^t>osa?ijx-^©fe#ii 

OkoU* . Perfect club 

benchmarks" tBflttl&X — '* 3 V If a. — ^ffl^ 
-7 - * 7* o 7 A ©-$£&# b ft ©T?<fc 

s. xmotsLw? it, r&mi ta**>) 

DO 1000 ££?!Hff 5 to © «*©* 'f y h 

sa^awca^oTt^s. e?ij rs jc-ot,->T(i, 

DO 1110 T- RS (1 : 9) ©ISffl#£8$n. 

^-^rticfcs&ft;*©-?!^ t rs (i : 9) ©®ffl 

$£»C DO 1130 rt©^#^(DT 
RS (6 : 9) ©©B*J<£ffi £ ft £ . ioT, RS 
{COl>TW DO 1000 T? ■M'- 7" |g&UC 
Tgfg£<£ffl©H&aW>t ta^JBJJ-fS. 
§i^«iiS©E?iJr -9 7 o -jgtfrlC <k o Tlfj £> 

£t<3a*. E?iJ RL ICOI,>T(ifg#TW/ < £l-'. 
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DO 1000 1=1, NMOL 

DO 1110 K = l, 9 

RS(K)=... 

1110 IF(RS(K).GT.CUT2) KC-KC+l •© 

1FXKC.EQ.9) GOTO 1100 

DO 1130 K=2, 5 

IF(RS(K+4).GT.CUT2) GOTO 1130 -® 
WK+4)=... © 

1130 CONTINUE 

IFflCC. NE. 0) GOTO 20 ® 

DO 1140 K-ll. 14 

=WK-S) © 

1140 CONTINUE 
20 DO 1150 

1150 CONTINUE 

1100 CONTINUE 

1000 CONTINUE 

0-1 Perfect club benchmarks ©— W 

RL (6 : 9) AigfflctlSCIi^© 
frt>K.C&0COt£T'&Z>. tCZii, KC©«t 
*10 KtlZ<Dlt&ftX®&e> RS (1 : 9) ©<i*s-r 
-tr CUT2 mT©J§£-e*s. i^T, 

®Vit RS (6 : 9) iS-f-tT CUT 2 EIT ttlZiz 

a. en rl (6 : 9) ^ofe&wnft *ns. -r 

ttft*>, ^©^©^fSffliX©©^®!!!*^ 
««ffi«olilR*«ttkv c©ci*ij5?$f-etn« 

f^^E^IJ'fb^Sl (array privatization), f /«£*3"&E 

n rl £&7" n -b x c t vifcfmtiwm. i 

•5-o©*?|i-K^frLT profile jg« (Hff^ 

©t»«) •ewtt^^ffJffll-sct-z?* 

■fur 7 A(D£C\t (MIC) *BL. 

*^»ciRmL^{«««-i'©i9»c 



1169 



Vol. 34 No. 9 



ffl 



©*<Slffi to r * 5 «>£ <i£ 8 > * r t lif o 

T t> 7- o / 7 Aj^WSffi X. T ^ 5 C i 

Jt'i^i*- !m&*tetim£ 

*©l»£g-f StiKfcS. @»&^SII5t«ife 
ffi t * © fc © S*f5 f C <« > T & 5 . 

2.2 jyrr^s^iigsRfcifj 

c n & «tB#tt£ft $ ft s& <t b -ctt& s ft 

2.2.1 tfetl=E = *«gi 

y K-etiN&s-jRm-f *ft*twru ji^ 
1x31*1- s&ts#g#3 ft*. w-'^»f 

Tt*# ZW.%t? 5 »IC*IB ©-" - K * * T«* 

(1) ■7u?7/*mft$kffimtiT 

•{fcftft. *»--y^»**«JR-f «&*©«» 

g^ibTfiJffl-f*- Xg^fAibTffcS 

(2) ftWa-kxmfjtt&mtit - 
&?lJfcHfT$n££7''a-lrXC: < i:©!!fT|gi& * 



jta g Sep. 1993 

tSH&£0Mi-Cg*f 3. Cft«C<fcoT7°n-fex 
EI©ll?T§l^«rffig-rSCi*<-Ct5. M^IJ^o 
^7A©ttffi|fi]±«r05IC(i. S-T'ci**©^ 

(3) •fa*t<y*$M'< : 7 V*)S?#T • 

ft£^g{ebfcisv#tt^#rpij±-f s. £ ft 

£©7" a -b y -9-*itt^±©-+: b y ? IC ti Z> C 

(4) 7°o-fe ytJ-F^ilfi^ -S^ 

TfiJt)^Tf>ft5. b*i* s ^"C, g^D-feytJ-© 
b Wr-* teT* o * y tfltf ©ggff£r 

frftfctfte©tt(,\ c©g©ftlit$-eii. r-* 

*^4.blC<t\ ^-^n-fey^©®^!!]^, ad 

(5) 7*a-by^g#rtlRjS#f 

a^©rtf?ici8-rstt«^s«-rs. rtiRib 

T»iHT©«B* s ^tft5. 

/.£i*. Cftf.JC.koT^jT'D^^AOtt^h 
^* y^*^fiSJCfj:S. 
2.2.2 « g£ m fit 

$>z>. itSMyiKk^ y /N ' 7{cioT^Wk^ft 
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c ft t> £ * — ? t (DUmr-mrktBl 5 tz tbK li 
tm<t >xt a ©rtgp^tf noxw&z a. --** 

gift*. COm^i, mL^Oltftii:?*-—? 

2.2.3 ypy^Ajfftt^ffi 
(1) ttlfHfcfWr 

& K 4 fc 4* a -f o ^ 7 a ±&rzo>mft MB 
gift*. 

a ) 7 n — #c# 



b) « ft # 

c) A # <S # 

d) til # ft # 



■c^«*imie!«R-f « ^fc#^ ,4> s ft r (,> 5 

#*.is>ft5. 

®-©^S«t. 'J a vlWif tfft*#5t 
■C * 5 ,0> -" ) . & K 4 *io 62 

yijf-* c©y-i> 

f h . tztz-tf, FORTRAN 7* 
n / 7 A t?Ji a * v i 3l|S:»c ftffl $ 

c omVr § fib $ ft £ 
t(DEno#JR$n«l6B (!>-s* 
a >")£##*<>©-?* 3. £#y - 
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•^g :/£LTJi&Tlc*-f 4o©ffig#<fc,5. 

• MOD (Modify) : Jgfg $ ft 5*Jtett© * S 
'J -S> 3 V 

• USE: ftffl$nS^J*6tt©*5'J -i? 3 v 

• KILL: &r*«3ft*U — 7 g V 

• EUSE (Exposed USE): £Sg$ft-f icftffi 

(saittffl) *ft* y -* 3 v 

'J-^^ili, *JR16H#*<Z>B?1I«<D* 
^-7 , CTi©ttSi^-7 B -e 

•J -*3 

U - 'J a >mVit£ tt. * t» »C flow-insensitive <£ 
*¥#f#5£,t flow-sensiitve /ig)ffii«* 3. |fj# 

ti, ffcw? d-«-#isl/xv\ -f /<£^8^y^J7 : •'- 
*^©£^£<£ffl©/fiJy£#^itL^^#tf;££^ 
±E MOD, USE ij -•>* 3 y« flow-insen- 
sitive n£^r*J6 oCiilUfU. 

^UiQDl7 n-^#^ L/;»*f 
IQ, KILL, EUSE y - J? a V OffiVrfirsj & t t£ 
Z. Cn&©y-^aVtt, flFHE?IJYt: (array 
privatization) r> tz toJC^^T* 5 . 
(2) ^Jttl^W 
( 1 ) tzfe&^m § »C 4 *J o ft 7* n 7 



A(i)=- 



=-A(i) 



— -A(i) 
(a)7o-ttff 



A(i)— ■ 
(b)&{*# 



=-A(i) 

I 

=-A(i) 
(c)A*«ff 



A(l)— • 

i 

A(i)=- 



(a) 



7a- 



(b) (c) A^Jft 

0-2 r'~^^#©M® 



(d) 



SUBROUTINE S(A,B) 
A(U)=C(U) 



DO20 j=2,N 
DO10 

A(g)=B(i,k) 

=A(ij) 

10 CONTINUE 
20 CONTINUE 
RETURN 
END 



usE=r f 

EUSE=( } 
KILL=(A(U)) 



K 



MODi={A(l:M.2:N)) 
USE={A(l:M t 2:N)) 
EUSE=(B(l:M.k)) t 
KlLL=tA(l:M,2:N)) 



)={A(1:M.1:N)) 
__={A(1:M,1:N" 
EUSE=(B(l:M,k) 



MOD= 
USE 



;M,1:N)) 
,„l:M,k)J 
K1LL=(A(1:M,1:N)) 
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a— ^©ftg-efffctfNgfcj&DA*. &n&& 

(3) ra^^AKJftS* 

as, *^*^#msmfatf©&?Mb£ 

g ; >xfAfii, afeJMfcTSTt&T?* 5 1 «ir-e * i 

3 7 fl&7£X (directives) *y -7. 

l\ L*»U #W> * 'J directives 
tt^Stt<Cv>. 3 7 WC© directives 

WiiltJgi'XfA^ 
h3-Ktt**M6*fc^TfcJ:v\ C© 
T^iftgM^'M 7 S. £ 

^ — y y h =i 7(Hjtf© directives £Jf Ab 

Fortran 77/Fortran 90 TfBxE $ 
tltz'S-x-faffJ*. *S^Ji HPF TE^b 

4 ^7 U *£A,KV ? j*^<z>%&tiift 



ft 8 Sep. 1993 

I'**. Sfi, &?!l7*o:? r 7 A©*-* try -r^fl 
«©^«>ICM5<Jft!lSJ 7 <f 7* 7 9 ©7/ !> -7-- •> g 
y?nf 7 A4 >fi 7*-x©£j®<t£§tti:l, 
fcffiB) (Message Passing Interface Standard Meet- 
ing) ##B-?&*oTv^. 

(4) ■faf-y^mmmtfr 
<o&#m&, ®r£<Dmm&&m t u * % & # $> 

C © -f a 7 A mm<Dtz i6IC£(T©«« A*fTffi 
• #«l#©n?tftnb!S& 
©ig& 

^©pI^kS^^^lclirn^^All 

(5) 

a. *©&, si 

±-r5*>^t,/«£l-'©-C(i^l,^^Sl''. -ec 
2.2.4 5»-^^-X<b«l«6 

«nr*>-t), ^^b$nfc7°a^7 * wmm* 

&?Mb£g f X 7 A |C t T . 



^ 0 








^- Turtle 
£860 


DO J 

Btii&ffl: ARRAYe«5«(J) 
£ £ : ARRAW/U) 
ft ffl : ARRAY^(J) 


ARR AY*i7/( J) » AR R^Yits«( J), ARRAY*«^J) 

Jm, Jn *COt>T 
ARRAY*i7/(Jm)^ARRAYf«e(Jn), ARRAY^«w(Jn) 
(Dffifc© Jm, Jn ICOt^T 

ARRAY*iV/(Jm)^ARRAY*i7/(Jn) 



1 
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^•^/c^lCJi, **3^|£©£5gAJ£#©j$ 

<,■>.&. 

£il&-f £*>©£>**. c©^©9f^Jt*HJc 

s-r. 3.1 Tii^^att-r5^<o* i ©^j 

^tA^l, 3.8 -e««E#6 3ftfKftL/£* 
7!Mb£j&i'*xA Parassist (Paralleliration Assist 
System) £j® %, . t£ fc, £-2 jc C C T# 9 ± 

3.i ± m m m 

toS.1.3 FORGE 90, 3. 1. 4 Express It 

3.1.1 VAST (Pacific-Sierra Research 
Corp.) 

PSR ttli 1971 mctSt&Ztl, FORTRAN/C 
U-f VAST £ffi&UT^S. VASTW^r-y 
directives £Jf A 1" fc o». JSLT, M^U<b 



Sep. 1993 

• A*— 7*Blft© parallel-secdons ©&tfj 

• parallel-loop £ parallel-sections ©^cfeg 
parallel-regions ^©-? — £/ 

• micro-tasking directives ©}$A 
3.1.2 KAP (Kuck & Associates, Inc.) 
Kuck & Associates fcfcji Illinois ;fc© D. J. Kuck 

Sgf,*n979^icsi:L^^tt-e*5. kapi* 

FORTRAN/C 7° d ?*7 Affl©^* 7 , ^ h ^ 
+ y •> ^ -<-^©7° a -fe , *^ygSYfc r 7 V X 

KIT. M3aKb©fc&lcjg(ft;**iT^S£g$^ 

• /u-ymsam mm. #m. ttm 

• &£©!#* 

• l^»3JgK©<g& 

• -f o-fex fork/join gg©{gj$ 

• ^&#©-f ySH 

• parallel-loop/paralll-sections ©&tn 

• micro-tasking directives ©Jf A 
3.1.3 FORGE 90 (Applied Parallel 

Reseach, Inc.) 
BM MIMDizer t^f tftlT (,"> tz tfffe* * 'J £ 
3feWltiHRiaBtf*W'«;X«S'XxA|C'«^ r;Wb 

«t&, *W>*yfflttA--7°^Hb&ffifc£*£iI 

JOU Fortran 90 *fj££ LfcttiSM h 7 U- 
FORGE *i^S7'o ; ?-7A)SWife**r'-^ 
window — ^©'f 7*-X$-ii^ L/Tl"> 

s. *r. 3— • tmM3aKttt«<©g#7 , o*-7 a 

^^i©HfT^P^profiletf«^5. a— TliC 
SIT. FORGE £$j£t-5±g-tf-7'> 

^ x a jc oor fffi* »c )SSJi-r 5 ,> - ,) . 
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a) ^p/7i«Jrt^^fi" 

b) Database Viewing 1h ^ •> X f- " 
Viewing «ttMlftSnTb^«. 



i S Sep. 1993 

• COMMON, EQUIVALENCE ^ 

• micro- tasking directives Ojf A 





x a £ 


# & 




VAST: 

Pacific-Sierra Research Corp. (#) 


• 3 7 directives J$A 




KAr . Kuck & Associates, Inc. (tk) 


•7a-b7> fork/join ®K<£& 

• parallel-loop/parallel -sections 

• micro-tasking directives If A 


& m 


FORGE 90: 

Applied rarauei Kesearcn, Inc. {7(0 


•70/7 AflftfriR^© Database jfc 




Express: Parasoft Corp.(^) 


• communication profiling tool 

• event profiling tool 

• memory access visualization tool 




ParaScope Editor : Rice ± (#) 






SUPERB : Bonn * (&) 


• ^.-^cD^fg^gTK 




PIE : Carnegie Mellon ^ (#) 


• cpu«fflrt»«* 




ParaGraph : 

Oak Ridge National Laboratory (#) 


• :/a-fe„ir£ft/<7 
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• It 7*— f- V3— DO 

y^-O DO 

#IC ^4£gli#$£»c£*:#-3/c^-7nff 

3.1.4 Express (Parasoft Corp.) 

Parasoft 1987 ^IC* <) 7 * »-Tim± 

Express > * !> ffl * 5U » «. 

7 — 9 Xf — ~> 3 y network-cluster [qjl^ © 3fc J'lJ 

S ,4> . tt*. BIT© a), b). c)t^«PM 
(Performance Monitor) <!: I ¥A<-C(i > 3. 

a ) CTOOL (Communication profiling TOOL) 
$.n-fvVy A<D&7*a-fext:£cD CPU B#fH3 

Afjj. cnicj;oT7*D-fe^r^iiw©*-^* 

<n . y K-f OS -yu, I/O &£-©£#> 

SI#IHI*:*n5 

b ) ETOOL (Event profiling TOOL) 

y 7* a y J, *%fs? ° * * ©SJ»H# 

c ) XTOOL (execution profiling TOOL) 

CPU ^g^ra^-g^-T 5. /a^JAfa-- 

y^ffl©*fe**Wtt««T?**. C©1t«KJ: 

-jTa-fT/J^-fa ^©5lfTfl8r©*^S5 

d) VTOOL (memory access Visualization 
TOOL) 

^7*o^7^©>*'J T^-feX^iK^T- 
f-* £ 2#5c^ h 'J v 9 *Kt y tfy^L, E 
C©*7*fXTAW, a-lf**/ 



Sep. 1993 

e ) ASPAR (Automatic and Symbolic PA- 

Rallelization)'" 
Wfc-f n 9- ? A £&?iJ 7° o ^ 7 ^ K S i&gg&f 

K»lcjR*r««M6*fc-3. <#K, ^^7AT 
ffliwsr^'ij xa«u t?iJiR]ior 

3.2 *^-&tfMS&M& 

T^5. «T, o<oi>(D->xfA*a 7 >t5. 
#»c 7 >c^ict)/c?), mKZ&vr^z rice*© 

i/XTMC-o^XK 3.2.1t?|^iBilCiS 7 >-r5. 
3.2.1 ParaScope Editor<>« 

Tv^&^B RICE ^c©'/^f Af$5. cntf 
R" (Rice Programming Environment)", PFC (Par- 
allel Fortran Converter)". PTOOL (Parallel pro- 
gramming assistant) 65 it^fc^XrA^ll^t 
T^TtJ«J, ParaScope \i C ft ££f£Jg£ -&tz •> 

(1) •fafvAlffi 

W7*-*ttftff©<^«#tt*WlMBi: depen- 
dency testing t^Mnmon^mmtimKmmi: 

jW8*3ttTt*$. »tfttJ8HST?tt*ttfWr«T 

TVS. 

(2) 

1*5. f-^tt#)»ff-Cli-^©E?iJA s PI^>* 
£#J$L-? *©*££, $Blc(i#& 

mmtZcblctiZ. LfctfoT, a— 
tt$fiWrfM&*M*-f 5 c £ *«-e ft 5 «fc -5 ic ti o 

tvs. ?-9tii&mvTZ™£:icfT?ctttmm 
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« & 



(3) 

■»'IC*«>7 v -*tt#*fci&*<s. a.— men* 

a ) reordering transformation 
b ) dependence breaking transformation 
it, BW«"/;MAfc£). 

c ) memory optimizing transfomation 

SPAttf). 

d ) miscellaneous transformation 

3.2.2 SUPERB (SUprenum ParallelizER 
Bonn)") 

SUPRENUM -fui?^? Y<D-nX~ rVy© 
Z. f-y.y SUPRENUM 

tfc> * u s#yyit#« t? * 5. superb tt*tg 

3!r *T?;fc»j, m^yniTy^ SU- 

PRENUM FORTRAN /d^a ICK& ? 5. 
SUPRENUM FORTRAN tt FORTRAN 77 Jt& 

It -5. cnKjcoTEjij^icsns^a^- 

£»C ttfT*. ft t fc T jfeai<fctt5B£ \C tt g 
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ogttic^i-g^rfet), afeWfcicHf sag 

* t> a. — ir (AM £ L Tv> 5 . 
3.2.3 PIE">."> 

MflHfci'XxATttfclV T/H-i/g 

SS-lS^fbS^-f 3. j.— *f u^juoffjg.^ os 
cpu ©fijfflrtf? 

mm 

3.2.4 ParaGraph") 

^ffis-r5^J6©»>^^A-e*t), 

# f * x A © A 2j tt h —X 7r-f A/fi 
0, h U-XfiMgtt PICL (Portable Instrumented 
Communication Library) tVZkitlZfc* 

ZtiZ. H^-xff«ttBlTlc^«t9^«*© 

• 7* o -fe „ -tj-tfj^ (busy, idle, overhead) ©B# 

3.3 Parassist 

Parassist tt»#6*«ttff Lfc^> * ij 
et£&ffltfM?!Hb3:g7*o M-f7'^fA ,,) f 

3, 3. 1 Ttt 4 ~3<D£mt£ 3 V - * y r 
S*84rU 3.3.2 TfifeWYfc«i**^r. 



E 

* 

ft 

7°. 
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3.S.1 i/^AUtfiEifclit 
(1) lltWfta^O 

a) $m. do vu-yati^yij{fc 
la&mb-fs. 

b ) directives |Cfl£ fc&JiHb 
• Parallel Section X 
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c) 



(2) S|f^fi , "' ,sw " 
flow-sensitive %\cZtztir>frm&., 

fcfttt?'-* £LT 7 

■tz. cots. ^^y-Pzmtti-iTit^zsim 

rt. S6K^**IHIWf*lT-5. c©{g, E?!)«? 

# fc * fc **o/c^SSe»«-«T 

*>*»>. EWy-^©tt#tWf»Itffl|R|±*Ho 

(3) t^fXtA*" 1 

a— fiWRbfc DO /i/-/OtJIJtt*)S¥*f 
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»--fCt © <5 J6 S Hfrl$R3£*^ 
b) £?iJttft?W 
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V A;fr>S> directives & J: Cf DO Jf— 

7£*«|WL**-f*. C©«*ttb) hp*©$ 

b ) ^jE&flHb directives ©&tn 

4 ©ttltBlc «t 5 * jE U * — 9 
directives Igftfflf S. 
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